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Initialize CS and/or CC for 
theme set for user 



At CS, obtain d at a signals from input devices U- Q ^ 



At CS, process data signals to produce attributes j 

representing user's context, \ \X f) h 

including adding required data fields, \ ^ 

such as attribute name, timestamp, units, etc. [ 



At CS, provide attribute to CM for storage }x ^ 0 S 



|^At CCTr equest fr Q ^^ M anc * receive attributes *4 ( § 



I At CC, process attributes to determine appropriate outputs ^ ' 2- 



l}f & 0 ( Provide output signal to user, other entity or other process -n^ *-( •' ^ 



Code 
Module A 
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I Code 
| Module D 



CM 
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Launch at start-up 
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Periodic ally receive GPS data stream ^ 



Parse and store GPS data 




^6 




Receive request ^\ ]\J 
for latitude, longitude or — 
altitude attribute? 



Y 



Provide requested attribute vaiue(s), with 

Time stamp , uncertainty, units, etc. 

- — ^ 
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piC-7 *dA 




Sit *^S^ 



Register for latitude, longitude and altitude attributes 




Normal operation? 




N Use default attribute mediator /"i 6$^ 



j^R eevaluate all latitude attributes] ^ 6^ 

i_ . 

j" Select lowest imcgrtainjy attribute m ecfiatorj^ 



Determine CS providing resulting attributes _ 




Request latitude, longitude and altitude attributes from CS/^i] 
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Notify feature active? .> 
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Receive input defining boundary ^ te 
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[Provide event parameters to CM regarding boundary transversal { 



Receive response fronf 
^-CIvl to established evengx^ Kl 
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tify user that boundary has been crossed 1 



User, 

Desired_privacvjevel 

Interruptibility 

Speed 

Direction 

Acceleration 

Availability. 

Cognitive_availability 

Tactile_availability 

Manual_availability 

Visual_availability 

Oral_availability 

Auditory_availability 
Proximity.<Item or place name> 
Mood. 

Happiness 

Sadness 

Anger 

Frustration 

Confusion 
Activity. 

Driving 

Eating 

Running 

Sleeping 

Talking 

Typing 

Walking 
Location. 

Place_name 

Latitude 

Longitude 

Altitude 

Room 

Floor 

Building 

Address 

Street 

City 

County 

State 

Country 

Postal_Code 
Destination, (same as User.Location.) 
Physiology. 

Pulse 

Body_temperature 

Blood_j?ressure 

Respiration 
Person.<name or ID>. (same as User.) 
Platform. 
UL 

Oral_input_device_availability 

Manual_input_device_availability 

Tactile_outputjievice_availability 

Visual_output_device_availability 

Auditoiy_output_device_availability 



Platform* (continued) 
CPU. 

Load 

Speed 
Memory. 

TotaI_capacity 

Used 
Storage. 

Total_capacity 

Used 
Connectivity. 

Connection_status 

Connectionspeed 

Connection_type/device 

Connection_activity 
Power. 

Power_source 

Powerlevel 
Environment. 
People. 

Nearest 

Numberjjresent 
Number_close 
Local. 
Time 
Date 

Temperature 

Pressure 

Wind_speed 

Wind_direction 

Absolute_humidity 

High_forecast_temperature 

Lo\vJbrecast_temperature 

People_present 

Ambient_noise_level 

Ambient_light_level 

Days.<previous or future>. 

High_temperature 

Low_temperature 

Precipitation_type 

Precipitation_amount 
Place.<place name>. (same as Environment.Local) 
Application. 
Mail. 

Available 

New_messages_waiting 
Messages_waiting_to_be_sent 
Phone. 

Available 

Injise 

On/off 

Notification_mechanism 
CalMncoming 
Caller_ID 
Soundrecorder. 
Available 
Recording 



User Setting 

Mental Context 
Meaning 
Cognition 

Divided User Attention 

Task Switching 

Background Awareness 
Solitude 
Privacy 

Desired Privacy 

Perceived Privacy 
Social Context 
Affect 
Physical Situation 
Body 

Biometrics 

Posture 

Motion 

Physical Encumberment 
Senses 
Eyes 
Ears 
Tactile 
Hands 
Nose 
Tongue 
Workload demands/effects 
Interaction with computer devices 
Interaction with people 
Physical Health 
Environment 
Time/Space 
Objects 
Persons 

Audience/Privacy Availability 
Scope of Disclosure 
Hardware affinity for privacy 
Privacy Indicator for User 
Privacy Indicator for Public 
Watching Indicator 
Being Observed Indicator 
Ambient Interference 
Visual 
Audio 
Tactile 



Computer 

Power 

Configuration 

User Input Systems 
Hand/Haptic 

Keyboard/Keystrokes 
Voice/Audio 
Eye Tracking 
Cursors 
Axis 

Resolution 
Selection 
Invocation 
Accelerators 
Output Systems 
Visual 

Resolution 
Audio 

Public/Private 
Haptic 
External Resources 
I/O devices 
Connectivity 

Data 

Quantity/State 
Urgency/Importance 

Use of Prominence 
Modality 

Sensitivity/Purpose 
Privacy Issues 
Use of Association 
Use of Safety 
Source/Ownership 
Types 

User generated 

Other computers or people 

Sensor 

PC State 
Use of Association 




Starting the Day 



Starting The Day Theme 



Today's Headlines 



CurrsntWeather 




Schooi Shooting Near San Diego Leaves Two 
Dead, More Than a Dozen Wounded 

Northeast t/.S. Waits for Worst of Snowstorm; 
Schools, Airports Disrupted 



France Finds Foot-and-Mouth Antibodies in 
Sheep; Animai Transport Curbed 



nssen to remain jailed until his triai ^ | 

To Do List Calendar 



inside Temperature: 70 v 
Outside Temperature: 36 
Wind:WNW@5mph 
Currently windy 



People at home 



Teif Dan about Tech Talk 
Remind DavidB about Design 
Fix DavidBs Computer 
Find kennei for dog - 
Take out the garbage 
Buy Bread and Milk 





10:00 Company meeting 



/I £5 




The Wife, 
The Kid 



Hi"? 



Fq. lift 



,7\ 



DrtvmQ to Work 



iTangte 

1184* Westtake Ave N 
\Seattte, WA 
17.636 N -T22.34 W 



Driving To Work Theme 
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First Mfeefirtd for the Day 

10:00 Company Meeting 



People to Call 



Jo*nrf425}444-5555LGf 

Mark Smith (2Q&J9Z6-62H SDE Offer 
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Attfvfng atWorkTherrie 



People in the Building 



To Po Ust 



Antei Johnson 



TefiDan about Tech Taik 



Remind DavidB about Design spec deadline. 
Fix DavidB's Computer 

Cat! Mark Smith (206)936-6214 about Job Offer 



1 Weekly Company meeting at 10:00pm 

2 VIA demo at 3:00pm Penthouse. Everyone invited. 

3 Who let my dog out?[Dan] 

4 Extra ticket to Sonics/Lakers game tonight[Josh] 

5 Who used decaf on the non decaf container?!? [At an] 



Tangis Bulletin Board 
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* At Work 



At Work Theme 



Calendar 



To D0 List 
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|& Conpany Meeting 
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Remind DavidB about Design spec deadiir 
Fix DavidB's Computer 
See Bitt about networking problems 
Calf Mark Smith (206}936-62U about SDE 



Teif Dan about Tech talk 



People Around Yau 



"50 



BUI Watson 
Alan Housley 
Dorothy B. 



f.q. (ID 



Company Meetinq 



Thlnflstobrinji up 



Meeting Theme 



iTeH grou p what you did last week 



Notes 



Finished coding Turing Machine on Monday. 
Did bug bash on Tuesday. 
Survived an earthquake on Wednesday. 
Worked on CTK demo rest of last week 
Continuing work on CTK demo rest of this week 



people Present 



iTeil group what you plan to do this week 
Tell group about your new Invention. 
Tell group about your upcoming skiing trip. 
Kudos for Stan and Dorothy for finishing report 



Aaron Graves 
Alan Housley 
An eel Johnson 
Bill Watson 
Brian Rose 
Cesar Alvarez 
Dan Newell 
David Jukes 
Dorothy B. 
Jaquie T. 
Jeff Fried 
Jim Robarts 
Johnson A. 
Josh Freedman 
Kanisha Patel 
Ken Abott 
Lisa Davis 
Molly Fitch 
Scott Price 
Stan Emert 
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. Meet with Bill 




Dan Neweli Tneme 



Recognize * J 
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Contact Information 



Dan Neweii 
Has met The Man 
Married with 1 year old son 



Reminders 


Ask him about his 90 day pfeft 
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Teii joke about Barbi. 
Ask Dan about his watch. 
TeiiDan about Tech Taik. 






invite Dan to Lunch. 
He owes you $10.00 
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. Lunch with Dan 




Going to Lunch Theme 
Restaurant In the Area *"%Z^\^^?kf^^ 



Thai Restaurant 
1800 WesUake Ave 




Previous 




is I A 

i7 i Hyisii^ 




That food. Highly Recommended. -Josh 
Pretty good thai food. Try out their panang. -Johnson 
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. Reparinq a PC 



Repairing a PC Theme 

Xom**tZWim*M jJosh^ Computer 3 
Description 



Notes 



PeH XPS 4068 

Purcitase Date: 11/20/2000 

Tang& Tag: PCD01 

Software Installed 



Office 2000 3 
Visual Studios 6.0 
MS Entertainment Pack 
Boeing Marketing Tutorial: How to 
talk iike a techie 

HfirdwarVlrwtaIIe<l 



{Currently inoperative 3 
Josh noticed a foud noise coming from 
the hard disk. 

He said it might be a problem with the 
disk's brake pads. 

If he mentions this again, humor him. 



Creative Sound Blaster 10.0 card 

Ricoh 32X CDRW 

MS USB Microphone 

Intel TR1688 100Mbps Token Ring 
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. Driving Home 



Driving Horns 




Your wife fc at Ncrdstroms. } 

Current house temperature: 55F 

Cftg / . { , , s Tatn cnHeat | 




To do list 



m 



Find kennel for dog 
Bring in the garbage 
Buy Bread and Milk 
Buy CO ice Cream 




Family Board 



fltfifeJ3:4i I am going to Nordstroms after work. 
[Son}4:40 Dad, Can you buy me some CC ice cream. 
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Driving Home 
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Driving Home 



Your wife is at Nordstroms. 



Current house temperature: 55F 



CALL 



Tod 



Find kennel for dot 
Bring in the garbac 
Buy Bread and Mil 
Buy CC fee Cream 




WARNING!!! 

SUDDEN STOP 
IMMINENT 



% UK 



i after work, 
jnye CC fee cream. 



To do list 



Arriving Home 



WhfefsonTV 



Find kennel for dog. 
Bring in the garbage. 
Heip Junior with Homework. 



01 M Komo TV Local News (4) 
07:30 Wait Street Week (9) 
01:00 Survivor IK (?) 
09:00 X-Files (13) 
10:00 Big Apple (7) 



Family Board 



People At Home 



JSpouseJ3M lam going to Nordstroms after work. 



[Son]4:40 Dad, Can you buy me some CC ice cream. 
[Spouse]5:15 Hi be home at around 6:30. Get dinner 
[fou]S:1S Sure Son. 
{You}6:00 I'm home. 



The Wife 
The Kid 



Example Current Theme Selection 

Select A New Current Theme 




Starting The Day 

Driving Home 
At Home 

Work-Related Group" 

Driving To Work I ^ £ 5 
Arriving At Work 
At Work 

Entertainment-Related Group 



r 



OK 



Cancel 



s"4 



Starting The Day 

At Home 
Eating Breakfast 



Figure 11M 

Example Current Theme Set Modification 

Current Theme Set 



Add Theme 



Remove Theme 



Figure UN 

Example Current Theme Layout Selection 
Select A New Current Theme Layout 

Starting The Day theme 
r~ Starting The Day - default layout 

/ / is o<s~ Starting The Day - vacation 

^- Starting The Day - responsible for dropping off kids 



OK [ I Cancel 



Figure HO 
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. Context Ctrl 
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illli^^ 



,. ' ; f Page Up ▲ 
# Choices: 



,1 New 



;iS2 Organize 
•|p Set Theme 

illt Me 
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Context_Ctri 



PageUp ^ 
# Choices: 
fi§i§1 New 
^«|2 Organize 
5g3 Set Theme 
Ill4 Me 



Ermmmtsrt 



Skjcds [ Bwg About 



Battery 
Mic Volume 
Backlight Is 



Signal Siren gth 

sps iiiiiT 



§|7 Places 
|l3 Environment 
2*9 Objects 



Page Down ▼ 




Example Theme Data Structure 



Name 



Description 



1305 
c 3'° 

(33© 
I 33S 

f 3 Y °iMmie- Active 
!35"o 



Driving To Work 



Intent Is To Organize Both Driving Info & Info About Work Arrival 



Security 



Oelsof-f-: X***^ SLIP: Xy&e-^XK 



Permission 



Privacy 



Priority 



Medium 



Group-ID 



23 



Mon-Fri, 06:00-11:00 



Source 



Jffi -Theme-Content 
f * # 4^ v New- Attributes 



BCD Motor Company 



'BCD Motor logo.gif ' 



DTW-BCD. driving-direction: (source = "BCD-DTW CS"); 



1=1 



Theme- 
Matching 



Theme-Logic 



user.activity.driving = true (required); environment.local.time = 08:00-09:00 
(optional); DTW-BCD. driving-direction = NOT "South" (required); 



IF <user. activity. driving> AND user.location.latitude > recent.user. 

location.latitude THEN DTW-BCD.driving-direction = "North"; 
IF DTW-BCD.driving-direction = "East" THEN Alert("You're Lost Again!!"); 
SET user, locationf Access] = Family & Co-workers; 



Attribute-Set < link 



in 




3i ( 



Attribute I 


c 


Attribute N 


i 


Name 


user, activity . driving 




Name 


DTW-BCD.driving-direction 


Value 


True 




Value 


West 


Uncertainty 


High 




Uncertainty 


None 


Timestamp 


07:32 03/24/XX 




Timestamp 


08:13 03/24/XX 


Units 


boolean 




Units 


North, North by Northeast, . . . 


Access 


Family 




Access 


Self 






• 



Figure 13 
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Phone, Internet, Time, 
Computer Network 



-Verbal- 
-GPS- 



/ / \ \ 



—Mouse 
-Keyboard — ►! 
— Time ► 



Fitters & 
Builds Datastore 



VJi -Message Loop*>) 




Actions 

Modify 
Windows 



Manage PIM 



Initiate calls, 
pages, faxes, 
email, web 
searchs 



Display 
Maps 



more.. 



Pattern Recognition 



Inference Engine 



Rules 
Time 



Place 



Command 



File 



Learning 
Preferences 



User Defined 
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